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Abstract. We give sharp, uniform estimates for the probability that a random walk of n steps on 
the reals avoids a half-line [y, oo) given that it ends at the point x. The estimates hold for general 
continuous or lattice distributions provided the 4th moment is finite. 



1. Introduction 

Let Xi,X 2 ,... be independent, identically distributed random variables with mean EXi = 
and variance EX^ = 1. Let S = T = and for n > 1 define 

S n — X\ + • ■ ■ + X n 

and 

T n = max(0, Si,..., S n ). 

The estimation of the distribution of S n for general random variables has a long and rich history 
(see e.g. EOl). 

The distribution of T n was found more recently. In 1946, Erdos and Kac [5] showed that 

lim P[T n < x^fn\ = 2$(x) - 1 

n— *oo 

uniformly in x > 0, where 

$(x) = -L f e- t2 / 2 dt 

V27T J-oo 

is the distribution function for the normal distribution. Several estimates for the error term have 
been proved on the assumption that E|Xx| 3 < oo, the best uniform bound (and best possible 
uniform bound) being the result of Nagaev lfT3l 

P[T„ < x^M = 2$(x) - 1 + 0(l/y/n), 

uniformly in x > (the constant implied by the O— symbol depends only on E|Xl| 3 ). Sharper 
error terms are possible when \x\ > 1, see e.g. Arak 01 and Chapter 4 of 0. 
We are interested here in approximations of the conditional probability 

Rn{x,y) = P[T n _i < y\S n = x) 

which are sharp for a wide range of x, y. By the invariance principle, we expect 

R„{uVE, vy/n) -> 1 - e - 2v{v ~ u) (n -> oo) 
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for u, v fixed, u < v and v > 0, since this holds for the case of Bernoulli random variables (see 
(1211) below). 

Before stating our results, we motivate the study of R n (x, y) with three examples, two of which 
are connected with empirical processes. 



2. Three examples 

The example which is easiest to analyze is the case of a simple random walk with Bernoulli 
steps. Let Xi,X 2 , . . . satisfy P[Xi = 1] = P[Xi = —1] = |. By the reflection principle, the 
number of walks of n steps for which T n > y and S n = x is equal to the number of walks of n 
steps with S n = 2y — x (by inverting X^+i, ■ ■ ■ , X n , where k is the smallest index with Sk = y). 
Thus, if n and x have the same parity, then 



I n \ 

\ n-\-x — 2y J 

R n {x,y) = 1 r n \ ■ 

l n — x J 

This includes as a special case a version of the classical Bertrand ballot theorem from 1887. Two 
candidates in an election receive p and q votes, respectively, with p > q. If the votes are counted 
in random order, the probability that the first candidate never trails in the counting is 

R P+q {q-p,l) = p + 1 • 

More generally, suppose 1 < y < n/2, —n/2 < x < y and 2y — x < n/2. Writing (3 = 
(2y — x)/n and a = x/n, so that (3 > a > 0, we obtain by Stirling's formula, 

r> ( \ -i 

Rn{x,y) = l- 



n \ 

l-(l + 0(l/n)), 



a 2 f(l + a) 1+a (l-aY~ a ^ n/2 



= 1 - (1 + 0(l/n))J]-£ exp (a 2 - f + O (a 4 + /3 4 )) } . 

If x = 0(^/n) and y — x = 0{^Jn), then a = 0(n~ l l 2 ) and /3 = 0(n~ l l 2 ) and we have 
(2.1) i2n(a:,j/) = 1 - (1 + 0(l/n)) exp{f (a 2 - /3 2 )} = 1 - e- 2 ^^ 2 )/" + 0(l/n). 

Two special cases are connected with empirical processes. Let U\, . . . , U n be independent ran- 
dom variables with uniform distribution in [0, 1], suppose F n (t) = - J2u <t ^ ^ s tne ^ r empirical 
distribution function and 0<^i<---<^ n <l are their order statistics. 

In his seminal 1933 paper [fTTI on the distribution of the statistic 

D n = Vn sup \F n (t) - t\, 

0<t<l 
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Kolmogorov related the problem to a similar conditional probability for a random walk. Specifi- 
cally, let Xl, X 2 , . . . , X n be independent random variables with discrete distribution 

(2.2) P[X j = r-l] = ^ (r = 0,l,2,...) 

Kolmogorov proved that for integers u > 1, 

n\c n ( 

P( sup \F n (t) — t\ < u/n) = P I max \Sj\ < u, S n = 

o<t<i n n \0<j<n-l 



P ( max ISA <u 

0<i<n-l 



S n = 



Consider next 



Q n {u,v) = P[& > *f (1 < i < n)} = P < (0 < t < I] 

for m > 0, v > 0. Smirnov in 1939 proved the asymptotic Qni^y/n, n) — > 1 — e _2A2 as n — > oo for 
fixed A. Small modifications to Kolmogorov 's proof yield, for integers u > 1 and for n > 2, that 

Q n (u,n) = R n {0,u) 

for the variables Xj given by (12.21) . When v ^ n, however, it does not seem possible to express 
Q n (u, v) in terms of these variables Xj. 

In [8], new bounds on Q n (u, v) were proved and applied to a problem of the distribution of 
divisors of integers (see also articles Q for more about this application). A more precise 
uniform estimate was proved in [0, namely 

(2.3) Q n (u,v) = l-e- 2uw/n + o(^^j {n > 1, u > 0, w > 0), 

where u> = u + v — n and the constant implied by the O— symbol is independent of u, v and n. This 
was accomplished using Xj = 1 — Yj, where Yi,Y 2 , . . . are independent random variables with 
exponential distribution, i.e. with density function f(x) = e~ x for x > 0, f(x) = for x < 0. 
Letting W k = Y x A YY k , Renyi QH whowed that 

te ' 6 ''"' a)and te^'-"'^ 

have the same distribution. An easy consequence is 

Q n (u, v)=P [Wj - j > -u (1 < j < n) | W n+1 = v]= R n+1 (n + l-v,u). 

3. STATEMENT OF THE MAIN RESULTS 

Our aim in this paper is to prove a result analogous to (12.11) and (12.31) for sums of very general 
random variables X\ . We will restrict ourselves to random variables with either a continuous or 
lattice distribution, to maintain control of the density function of S n . Let F be the distribution 
function of X x and let F n the distribution function of S n for n > 1. Let 4>(t) = Ee J * Xl be the 
characteristic function of X%. 
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that either 

{Xi has a continuous distribution and 
3n : j \<f)(t)\ n » dt < oo 

(L) Xi has a lattice distribution. 

If (L), let f(x) = P(Xi = x), f n (x) = P(S n = x) and n = 1. We also suppose the support of / 
is contained in the lattice Jz? = {7 + m\ : m G Z}, where A is the maximal span of the distribution 
(the support of / is not contained in any lattice {7' + m\' : m G Z} with A' > A). The support of 
f n is then contained in the lattice Jzf n = {727 + m\ : m G Z}. If (C), let / be the density function 
of Xl, let /„ the density function of S n , define J£ = R and Jzf n = R. 
Define the moments 

« u = Exr, (3 u = nx l \ u . 

In what follows, the notation / = 0(g) for functions /, g means that for some constant c > 0, 
l/l < eg for all values of the domain of /, which will usually be given explicitly. Unless otherwise 
specified, c may depend only on the distribution of X\, but not on any other parameter. Sometimes 
we use the Vinogradov notation f <^ g which means / = 0(g). As R n (x, y) is only defined when 
f n (x) > 0, when f n (x) = we define R n (x, y) — 1. 

Theorem 1. Assume (C) or (L), f3 u < 00 for some u > 3, and let M > 0. Uniformly in n > 1, 
< y < My/n, < z < M^/n with y G J£ n , y - z G S£ n and f n (y - z) > 0, 

^(y - *, y) = 1 - + O (^±1±1 + -±r) . 

Here the constant implied by the O— symbol depends on the distribution of X\, u and also on M, 
but not on n, y or z. 

Corollary 1. Assume (C) or (L) and j3 u < 00 for some u > 3. For w < v and v > 0, 

R n (wV^,vV^) = 1 - e- 2v{v ~ w) + 0(n~ 1/2 ), 
the constant implied by the O— symbol depending on max(t> , v — w) and on the distribution of X\. 

Corollary 2. Assume ( C) or (L), and (3^ < 00. Ify and z satisfy y — » 00, y = o(\/n), z — > 00, and 
z = o(\/n) as n — > 00, then 

hm R ^y-;^ = 1. 

n^oo 2yz/n 

All three examples given in section [2] staisfy the hypotheses of Theorem 1 and the two corollar- 
ies. Indeed, for these examples all moments of X\ exist. 

Using "almost sure invariance" principles or "strong approximation" theorems (see e.g. Hi, 
lfT5lO . one can approximate the walk (S n ) n >o with a Wiener process W(n) . Assuming that /3 4 < 00 
and no higher moments exist, one has S n — W(n) = o(n 1//4 ) almost surely, the exponent 1/4 being 
best possible (cf. flU, Theorems 2.6.3, 2.6.4). This rate of approximation is, however, far too weak 
to prove results as strong as Theorem [TJ 

In section|H we list some required estimates for f n (x). Section [5] contains two recursion formu- 
las for R n (x, y). Although our main interest is in the case when y > x, we shall need estimates 



We henceforth assume 
(C) 

or that 
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when y < x in order to prove Theorem [Q This is accomplished in $6] Finally, in J71 we prove 

Theorem [TJ It is critical to our analysis that the densities f n (x) have regular behavior, and the 

hypotheses (C), (L) and (3 U < oo ensures that this is the case for |x| = 0(-y/n). Extending the 

range of validity of the asymptotic for R n (x, y) beyond the range of (x, y) covered by Theorem [T] 

would require that we have more precise estimates for f n (x) for \x\ of larger order than ^/n. In 

specific cases, such as the exponential distribution, normal distribution or binomial distribution, 

exact expressions for f n (x) make it possible to achieve this goal (see e.g. (12.31) ). 

It is of some interest to know if (3^ < oo really is a necessary condition for Theorem 1 to 

hold. Recently, Addario-Berry and Reed [1J showed (as a special case of their Theorem 1), for an 

arbitrary lattice random variable X x with zero mean and finite variance, that 

yz yz 
(3.1) — < R n (y - z,y) < — (1 < y, z < y/n, n > n Q ), 

n n 

the constants implied by the <C-symbols and n depending on the distribution of X±. The same 
proof gives (13.11) under hypotheses (C) and /?2 < oo; see fla]) below (for non-lattice variables, the 
authors prove analogous bounds for the probability that T n < y given that y — z — c<S n <y — z, 
for a fixed c > 0). When y = 1, the upper bound in (13.11 ) is the same as the conclusion as 
Theorem [TJ but is proved under a weaker hypothesis. When y is larger, however, the error term 
in the conclusion of Theorem Q] can be of much lower order than the main term, and a hypothesis 
stronger than fa < oo should be required. Addario-Berry and Reed also construct examples of 
variables X x where EX^ = oo or k/^/n — > oo, while R n (—k, 1) is not of order k/n. 

4. Estimates for density functions 

At the core of our arguments are approximations of the density function f n (x). This is the only 
part of the proof which uses the hypothesis on <p{t) from (C). 

Lemma 4.1. Assumer ( C) or (L), and fa = 1. Then, uniformly for n > n and all x, 

(4.1) f n (x) « 



Assume 3 < u < 4, f3 u < oo, and ( C) or (L). Then, uniformly for n > uq and x G Jz? n , 



fn(x) 



-x 2 /2n |- 1^13 

+ o — + 



n n 2 



+ 0(n 



y/2im 

p—x^ /In i I . ... I 

! + o ( q/0/ J 1 n , : + n^' 2 



\n 3 / 2 (l + x 2 /n) 



Proof. We apply results from [flOll . §46, §47 and §51. Assume (C). By the proof of Theorem 1 
in §46, we may replace conditions 1), 2) of §46, Theorem 1 and the theorem in §47 with the 
hypothesis that n exists. Note that these theorems are only stated with the hypothesis that (3 U 
exists for intergal u, but straightforward modification of the proofs yields the above inequalities 
for real u G [3, 4]: Start with the inequality e lt = 1 + it — \t 2 — |t 3 + 0(|t| n ), which follows from 
Taylor's formula for \t\ < 1 and the triangle inequality for \t\ > 1. Consequently, 

= 1 - If> - + 
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and hence, for |t| small enough, 

<p n (t) = exp 



— t 3 + 0(n\t\ u ) 

2 6 



1 - 



^ + ^6 n 2 e O(|t|3 n ) + | f |„ ne O(|trnA 



Here we used the inequalities |e" — 1| < \v\e^ and je^ — 1 — v \ < \v\ 2 e^. Therefore, 



(4.2) 



n (t) - e" m " /z I 1 - -^-f 

6 



nt 2 /2 f i _ ta 3 n +3 



< (tV + |t| V)e 



1*1 < c) 



for some c > 0. In the proofs in §46, §47 and §51, use (|4.2I) in place of Theorem 1 of §41. □ 

5. Recursion formulas 
It is convenient to work with the density function 

R n (x, y) = f n (x)R n (x, y) = P[T n _i <y,S n = x]. 

The last expression stands for ^P[T„„! < y, S n < x] when (C) holds. Notice that if f n (x) = 0, 
then R n (x, y) = by our convention. 

Lemma 5.1. Assume (C). Then, for n > 2, y > and s > 0, 



R n (y + s,y)= f{a + t)Rn-i(y -t,y)dt. 
Jo 

If(L), then for n > 2, y > 0, s > andy + s 6 Jzf n , 

Rn(y + s,y)= ^ f( s + t)Rn-i(y -t,y). 

S + te^fn 

t>0 

Proof. If S n = y + s and T n -\ < y, then X n = s + t where t > 0. 



□ 



Lemma [5J] expresses i? n (x, y) with x > y in terms of i? n _i(x, y) with x < y. The next lemma 
works the other direction, and is motivated by the reflection principle: a walk that crosses the point 
y and ends up at S n = x should be about as likely as a walk that ends up at S n = 2y — x (by 
inverting the part of the walk past the first crossing of y). We thus expect that for x < y, 

R n (x, y) » f n (x) - f n (2y - x). 

Lemma 5.2. Assume n > 2, y > and a > 0. If(C), then for any x 

R n (x, y) = f n (x) - f n (y + a) + R n (y + a, y) 

n-l 



poo " ^ 

+ / y2R k (y + ty)(fn-k(a-0-fn-k(x-y-0) 

J ° k=l 
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If(L), then for x,y + a G Jz? n , 

R n (x, y) = f n (x) - f n (y + a) + R n (y + a, y) 

n-l 



k=l y+te&k 



Proof. First, we have 



R n (x, y) = f n (x) - P[T„_! > y, S n = x] 

= fn{x) - f n (y + a) + f n {y + a) - P[T n _i > y, S n = x). 

If Tj > y, then there is a unique k, 1 < k < j, for which T k -\ < y and Sk > y- Thus, 

n 

fniy + a) = ^P[T fe _! <y,S k > y,S n = y + a]. 

k=l 

If (C) then 

poo 

fn(y + a) = ^2 / P[T fc _i < y, S k = y + f , S n = y + a] d£ + P[T n _i < y, = y + a] 
fc=i Jo 

1 poo 

= / Rk(y + £, y)fn-k(a -Qd£, + R n (y + a,y). 
k=i Jo 

Likewise, if (L) then 

n-l 

/n(y + a) = R n (y + a,y) + ^ R k(y + H,y)fn-k(a-£.)- 

k=l y+^k 

In the same way 

P[T n -i >y,S n = x} = P[T fc _i <y,S k > y, S n 



n-l 

... - .. " x ) 

k=l 



E 



, Ey+€e^ fc ^fc(2/ + f , y)fn-k{x -y~0 if (L). 
fc=i k £>o 



□ 



Motivated by the reflection principle, we will apply Lemma 15.21 with a close to y — x. The 
integral/sum over £ is then expected to be small, since f n -k{y — % — £) — f n -k{% — y — should 
be small when £ is small (by Lemma |4~TI) and i?fe(y + £, y) should be small when £ is large. This 
last fact is crucial to our argument, and we develop the necessary bounds in the next section. 
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6. Rough Estimates 

Roughly speaking, if T n _i < y and S„ = y + s with s > 0, then S n _i will be close to y with 
high probability. The probability that T n _i < y is about min(l, y/ y/n) (see Lemma [67T1 below) 
On the other hand, if y/ y/n is large, then S n _i ~ y is a rare event. Therefore, as a function of y, 
R n (y + s ) y) should increase linearly in y for 1 < y < y/n, then decrease for larger y. 

We begin with a lemma concerning the distribution of T n . Part (1) is due to Kozlov ( Ifl2ll . 
Theorem A, (13)) and part (2) was proved by Pemantle and Peres (031, Lemma 3.3 (ii)). In [|T4|. 
(2) is stated only for h = 0, but the same proof gives the more general inequality. 

Lemma 6.1. Assume X\ is any random variable with f3 2 = 1- T^/zen 

(1) P{T„, < h] < (A + 1)/^. 

(2) E{^|T n < /i} < n , uniformly in h > 0. 

Theorem 2. Assume (C) or (L), f3 2 = 1 anJ n > 1. For all y > 0, z > 0, we /?ave 

~ min(?/ + 1, v^) min(2; + 1, y/n) 

(a) R n {y-z,y)<. ^ . 

T/'ra > 3no, y > y/n and < z < y/2, then 

(b) Rn(y-z,y < 1 2 ,V J . 

IT 

Proof. The proof of (JaJ) follows the upper bound proof of Theorem 1 from [1J. The idea is to 
consider simultaneously the random walk 0, Si, S 2 , . . . and the "reverse" walk 0, Si, S 2 , ■ ■ ., where 
S k = -(X n + + ■ • • + X n _ k+1 ). Let f n = max(0, S u . . . , S n ). Note that T n < y and 
S n = y- z imply T n < z. 

Inequality da]) is trivial for 1 < n < 3n . Let n > 3n , put a = [n/3\ and b = n — a. Then 
R n (y ~z,y)< P(£i, £ 2 , £ 3 ), where £?i = {T a < y}, £ 2 = {f a < z} and £ 3 = {S n = y - z}. 
Think of the random walk 0, Si, . . . , S n as the union of three independent subwalks: one consisting 
of the first a steps, one consisting of steps numbered a + 1 to b, and one consiting of the last a steps 
reversed. Note that E 3 = {Sb — S a = y — z — S a + S a }. Since Sb — S a is independent of S a , S a 
and of events E\ and E 2 , we have by (14.11) 

P(E 3 \E 1 ,E 2 ) < supjUH < n- 1 ' 2 . 

w 

As Ei and E 2 are independent, we have by Lemma [67T1 part (1) 

K(v -*,»)< PJ?, P£ 2 P{jy*,*> « ^^g . 

To prove @, we observe that S n = y — z > y/2. Thus, S a > y/Q, S b — S a > y/Qox S a < —y/Q. 
Suppose first that S a > y/Q. Replace E 1 by E[ = {S a > y/Q} in the above argument and note 
that 

■^r^ ES^ 36a n 

ns« > m < ^ = « - 2 . 
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Arguing as in the proof of (HD, we find that 

P{T n <y,S n = y-z,S a >y6\<^ — < . 

\y 2 J n y 2 

Next, suppose that Sb — S a > y/6. In the above argument, replace E\ with E" = {St — S a > y/6}. 
Then E 3 = {S a = y-z-(S b - S a ) + S a }. Again, P{E 3 \E'>, E 2 } < sup w f a (w) < n~ l l 2 and 
we obtain 

D r T ^ c c c ^ /R -i „ min(z + 1, y/n) 
P{T n <y,S n = y-z,S b -S a > y 6} < . 

y 

Finally, suppose S a < —y/6. Replace E 2 with E' 2 = {S a < —y/6,T a < z}. Here we use the 
trivial bound PEi < 1 and deduce 

P{T„, <y,S n = y- z, S a < -y/6} < PE 1 PE' 2 P{E 3 \E U E' 2 } « n^PE',. 

By Markov's inequality and Lemma [67T1 parts (1) and (2), 

PE' 2 < P{T a < z}P{S a > y 6 \T a < z) < P{T a < z) 1 f a ~ 5 < 1 ' V ' • 

{y/6) 2 y/n y 2 

This completes the proof of ©. □ 

Combining Theorem [2] with Lemma l5Tl gives us useful bounds on R n (y + £, y) when £ > 0. 
Theorem 3. Assume (C) or (L), and (3 2 = 1. Suppose y > and £ > 0. TTien 

^n(y + & 2/) « ^ ^°°(* + + A « 

Tjfn > 3n + 1 and y > v^- 

y 2 Jo n 1 ' 2 

Proof. Apply Lemma 15.11 and Theorem [2] flU) for the first part, and observe that the integral is 
< E|Xl|. For the second part, use Theorem [2] © for t < y/2, and R n -i(y — t,y) <C rT l l 2 for 
t > y/2. □ 

7. Proof of Theorem [j] 
We begin by proving a lemma which is of independent interest. 
Lemma 7.1. Assume (5 U < oo for some u > 2, and y > 0. If(C) then 

r>00 



If(L) then 



E / r- 2 ^n(z/+e,z/)^ = o(i). 

n=l ^ 



E E r- 2 ^(y+e,y) = o(i). 
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Proof. Assume (C). First, 

3«o ^.00 3no poo 3n 

n=l ^° n=l ^° n=l 

By Theorem |3l 

E r +{,»)«<( E A+ E 

n>3no+l \3n +l<n<y 2 +l ^ n>y 2 +l 

/»oo /*oo 

• / (f + i) / C' 2 f^ + t)d^dt 

Jo Jo 

i /*oo /»oo 

+ E ZT72 / /(« + y/2)d«df 



n<y 2 +l 

/■oo 

«E(|X l r + |X l r- 1 ) + ( 2 / + l) / v u - 1 f{v + y/2)dv 

Jo 

< 1 + E|X 1 | U < 1. 

The proof when (L) holds is similar. □ 

Remark. A random walk S , Si, . . . with (3 2 = 1 crosses the point y with probability 1. There is a 
unique n for which T n _ x < y and > y, and Lemma FT7T1 states that E(S n — y) u ~ 2 = 0(1). 

We now prove TheoremQ] (again showing the details only for the case of (C) holding). It suffices 
to assume that n is sufficiently large. Let n > 10no and put x = y — z. By Lemma 15721 with a = z, 



R n {x, y) = f n {x) - f n {y + z) + R n {y + z, y) 
(7.1) "^ n - 1 



poo 

+ / y2 R n-k(y + ^y)(fk(z-0-f> 
Jo k=i 



-0-fk(-z-0)dt 



If p u exists, where 3 < u < 4, then 

/ (t+ + t) dt = P{Xi > O + / P{^i > £ + *} dt < — 
Therefore, by Theorem [31 

y + 1 



(7.2) Rniy + ^yX 



n 



3/2( 1 + ^)«-l- 



Let Vi be the contribution to the integral in (17.11) from 1 < k < n , let V2 be the contribution from 
uq + 1 < < n/2 and V3 is the contribution from n/2 < k < n — 1. By (17.21) . 



I -| n poo I 1 

(7.3) /*(* - + - * = 2 ^^- 

fc=i >/o 
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When k > n + 1, Lemma [47T1 implies that 
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fk(z-t)-M-z-t) 



V2nk: 



fc(«~l)/2 



(7.4) 



+ 
1 



+ 



£3/2 £5/2 



+ 



£3/2 £5/2 



-(z+0 2 /2fc 



jfc(«-l)/2 

By (17.21 ), we have 



c + (j+iK|+i) e -(,-e»/M 



£3/2 



3/2 



E 



rco+l<fc<n/2 



2 + 1 



-(2-0 2 /2fc 



o fe(«-i)/2(^ + ArV 2 (£ + l)«- 



< 



y + i 

3/2 



1 Z" 00 1 



The integral on the right side is 



k<n/2 
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By Lemma O and (ITU) . 
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Putting together ( TO) . (17/21) . (1731) . (1731) and (1731) . we arrive at 
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Since |x| < My/n, Lemma l4Tl implies f n {x) 3> n x / 2 for sufficiently large n, the implied constant 
depending on the distribution of X\ and also on M. Hence 
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Finally, by Lemma |4~T1 again. 
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Again the implied constant depends on M. This concludes the proof of Theorem [TJ 
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